"System and method for digitally editing a composite image, e.g. a 
card with the face of a user inserted therein and for surveillance 
purposes" 

Field of the invention 

The present invention relates to a system and method for 
digitally editing a composite image, e.g. a card with the face of a 
user inserted therein and for surveillance purposes. 

Background of the invention 

In the present disclosure, the term "subject" will mean the 
user, for example, the face of the user, to be embedded in a "view" 
or "panorama" as prestored in the system, for example in a picture 
postcard, which can be selected by the user from a plurality of pre- 
stored cards. 

The term "view" or panorama, will mean a prestored 
background image of the considered composite product, for example 
the above mentioned picture postcard, reproducing, for example, a 
seascape or a mountain scenery, view of towns and the like, as it is 
conventional in picture postcard in general. 

The term "background-subject assembly" will mean a 
background actually present on the rear of the shoulders of a user 
which is taken by a camera as the subject is taken, for example the 
face of the user. 

The tenn "taken background" will mean a background which 
is taken by the camera with a 

free taking field, i.e. without the presence of the subject. 

Finally, the term "reference background" will mean a virtual 
working background, or a valid background, on which the novel 
cropping operation according to the invention will be performed. 
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It should be moreover pointed out that the terms "taken 
background" and "reference background" or "virtual working 
background", are novel concepts according to the present invention. 

Several electronic image processing methods and techniques, 
as well as the related systems, for making multiple-purpose printed 
image products and are already known in the art. 

Such prior methods and systems comprise, for example, 
methods and systems for making composite cards (as indicated by 3 
in Figure 3), comprising, for example, a view or panorama (indicated 
by 4 in Figure 3) having the subject inserted therein, for example a 
user face (indicated by 6 in Figure 3), arranged at one or more preset 
positions, for example at the left, center or right, with an optional 
arrangement of text or caption parts (as indicated by 32 in Figure 3) 
and so on, and methods and systems for respectively making one of 
the so-called "special products" such as greeting cards, photo-cards, 
stickers or adhesive labels, visiting cards, and so on. 

With reference to the making of composite cards, or cards 
incorporating a subject therein, reference is herein made to the prior 
art disclosed in the US-A-5,345,313, US-A-5,577,179 and US-A- 
5,469,536, documents all issued to Arthur M. Blank, which are 
incorporated therein by reference, and of which the last two are 
"continuations-in-part" of the first. 

In this patents, for separating a subject from a background- 
subject assembly, which operation is herein called "cropping", there 
is used a known "chroma-key" method which, on one side, requires 
a monochromatic background on the rear of the shoulders of the 
subject inside a closed booth assembly (US 5,577,179, Figure 1) or 
outside thereof (US 5,345,313, Figure 1) and, on the other side, 
provides to crop the subject by operating on a single image, or on 
the "background-subject assembly". 

The monochromatic backgrounds on the rear of the subject 
shoulders, included the grid backgrounds having like dot patterns in 



individual mesh arrangements thereof (US 5,345,313, Figure 2) form 
"static backgrounds", which cannot be varied. 

According to the mentioned chroma-key method, the 
monochromatic background must have a size greater than that of the 
subject, and, in the cropping operation, all the pixels having a preset 
color and similar colors would be removed from the background, 
with a consequent danger of also removing subject parts having said 
preset color or similar colors, for example parts of a blue shirt, in the 
case of a blue reference color. Accordingly, the composite card 
could further include undesired and anaesthetic "holes" as well as 
subject contour unevennesses. 

In US-A-5,345,313, the contour of a subject, for example of 
the figure of a person, has a first shade, and the background-subject 
assembly (taken with a monochromatic or outer "static background") 
has a second shade. According to the "chroma-key" method, based 
on the difference between the two shades and a preset shade 
difference, the system processor will focalize the edges of the 
subject and remove background portions arranged outside the 
subject edge or contour. The thus cropped subject can be then 
combined with a "view or panorama background" preselected by the 
user so as to form a composite picture card (indicated by 1 in Figure 
3) as above illustrated. 

In the modified embodiment including a grid background, said 
background is stored in the system. 

The method and related apparatus disclosed by the US-A- 
5,577,179 document provide to store the digital image of a subject, 
and a background-subject assembly, as well as at least a further 
view, which can be selected from a plurality of prestored views or 
panoramas, which view comprises several components, in a 
tridmensional or layered pattern. The subject contour has a first 
shade and the background behind the shoulders of the subject has a 
second monochromatic shade. 



As in US-A-5,345,313, the "background-subject" assembly is 
cropped to successively remove background portions outside the 
subject contour. Then, after the cropping operation, the subject can 
be combined with the selected view thereby providing the desired 
composite image or card. Means are moreover provided for making 
the introduction of the subject into the view much more "realistic". 

More specifically, according to the US-A-5,577,179 patent, to 
components of the preselected view, related X-Y plane locations, as 
well as a value defining their positions in one of a plurality of layers 
forming the Z-dimension of the image are assigned. Moreover, to the 
subject being incorporated into the view, a value defining its 
location in at least one of said layers is assigned. For processing the 
image an image processing method with multiple-layer arrays or 
matrix patterns, or a "transparency" processing method, which 
likewise requires the use of a monochromatic background which, as 
in the case of a grid background, will form invariable 
monocliromatic, i.e. "static" backgrounds are used. 

In addition to using the method disclosed by the US-A- 
5,577,179 document, the US-A-5,469,536 patent discloses to 
selectively assign to a mask the colors of a digital or video image 
and, more specifically, of the full image or of a selected area of said 
image. The color processing can be then carried out on the colors of 
the images defined by the mask. The latter can be used either with 
the overall image, a selected area thereof, or with subjects. 

Finally, it is pointed out that, as thereinabove stated, the 
chroma-key method does not provide to use either a "background 
taken without subject" or a "reference background" as shown, for an 
easy understanding, in Figures 4B and 4B1, exclusively for 
facilitating a comparing with the teachings of the present invention. 
It should be moreover pointed out that the chroma-key method does 
not allow to use multi-chromatic backgrounds, or backgrounds 
holding, in addition to the subject, other figures, possibly randomly 



distributed, as those which would be encountered, for example, in a 
case of take backgrounds, according to the invention (Figure 5B), 
taken by a camera without booth assemblies, i.e. having a free- 
standing taking field, which "taken backgrounds'* (Figure 5B) can be 
accordingly defined as "dynamic backgrounds". 

WO 93/17.517 combines the teachings of both US-A- 
5,345,313 and US-A-5,577,179 documents. 

The above mentioned methods and related processing and 
cropping methods have a lot of drawbacks and disadvantages, both 
with "static" backgrounds in a booth assembly and with "static" 
backgrounds in an outside environment. 

A main disadvantage is that the booth assemblies will require 
a comparatively large installation surface, usually of about 2 m.2, 
which, added to the area necessary for the circulating persons, 
likewise of about 2 m^, will provide to an overall installation surface 
of about 4 m2. 

Accordingly, the installation of the above mentioned closed 
booth assemblies can be made, and is justified, exclusively at large 
surface locations, for example at rail stations, subway passages, 
large motor way restaurants and so on. In this connection it should 
be moreover considered out that current booth assembly are not 
monitored by personnel. Accordingly, in a failure event, the 
apparatus will remain unused up to a subsequent inspection by a 
servicing operator, according to a preset monitoring rate. The 
economic damage would be self-evident. The technical servicing of 
the mentioned booth assembly, furthermore, is conventionally 
performed by a technical operator staff, whereas the periodic 
servicing, i.e. the servicing for removing the paid money and 
replenishing the consume materials, is carried out by those persons 
or companies who have bought or contracted the booth assembly. 

Considering the comparatively large size of prior booth 
assemblies, it would not be possible to use them in conventional 



business places and stores of comparatively small size, such as 
photographic material stores, bars, stationery shops, tobacco shops 
and so on. 

A further disadvantage of current booths of the above 
mentioned type is that each booth is provided for making a single 
product. Accordingly, in order to provide several products, a lot of 
booth assemblies are frequently installed one near the other, possibly 
with different technical servicing and periodic replenishing 
networks. 

The size problem is further compounded in systems with an 
outer monochromatic background, either with or without modular 
dot arrangements (US-A-5,343,313). This background would have a 
size of several nfi and, moreover, would require a distance of 
several meters from the system casing, thereby the above mentioned 
apparatus can practically be used exclusively in exposure rooms or 
the like. 

The US-A-5,764,306 discloses a real-time method of digitally 
altering a live video data stream to remove portions of the original 
image and substitute elements to create a new image without using 
traditional blue screen techniques. 

The requirement of operating in real-time will only furnish a 
mediocre quality of the produced composite images. Another 
shortcoming is to be seen in the limitation of the used colors. For 
example, for achieving better results the operator should not be 
wearing colors that correspond directly to colors that are directly 
posterior in the reference view. 

Another limitation is to be seen in the fact that the reference 
background should be substantially static and with a sufficient and 
stable light source. 

It is also stated that the suggested method allows for easy 
adjustments by the operator and that the software also allows for 



I 



7 



automatic adjustment. However, said US-A-5,764,306 is silent about 
how this should occur. 

The US 4,891,660 A discloses an automatic photographic system 
and frame dispenser including proximity detector means for 
detecting the proximity of one or more persons as well as means 
responsive to the detected presence of one or more persons to 
produce a recorded announcement orally inviting such persons to 
utilize the equipment. 

The WO 99 55 995 A discloses an access control system in winch a 
□ presence sensor is mounted to detect the presence of a person within 

m the system cubicle. 

y . The EP 0 626 611 A discloses a photographing box in which if any 

Jh trouble takes place in any place in the photographic system, the 

ji ? trouble information is sent out from a controller to a phone line and 

r is read into a host machine. Said trouble information could also be 

^ sent out through a radio machine and received by another radio 

H* machine from which the information is read into the host machine. 

~i 

y 5 

u After a lot of tests under very different conditions the inventor has 

also found that 

- the known presence sensors operating with the microwave 
technology could affect the reliability of the systems incorporating 
said sensors, 

- that it would be desirable to further reduce the operating time of 
the suggested system, and 

- that it would be desirable to also use the suggested basic concepts 
in fields different from the digital printing field. 

Summary of the invention 

Accordingly, the aim of the present invention is to provide an 
improved system and method, of the above mentioned type, free of 
the drawbacks and disadvantages of the prior art and adapted to 
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operate without requiring prior monochromatic or "static" 
backgrounds, while using a camera free taking or shooting field. 

Within the scope of the above mentioned aim, it is an object 
of the present invention to provide an improved system and method 
specifically designed for making, in addition to the above mentioned 
composite card, upon selection, so-called "special products", such as 
visiting cards, greeting cards, stickers or adhesive labels, photo- 
cards and so on. 

Another object of the present invention is to suggest an 
improved system and method the basic concepts of which may also 
be used in fields different from the digital printing field, for example 
in the spatial surveillance or safety field. 

Yet another object of the present invention is to suggest a 
simplified and quicker managing software with respect to the basic 
embodiment. 

Another object of the present invention is to suggest a new 
way to substitute the known presence microwave sensor with a new 
kind of presence sensors. 

According to the aspects of the present invention, the above 
mentioned aim and objects are achieved by systems and methods 
having the features claimed in claims 1, 1 1, 33, 34, 39 and 40. 

Further advantages and embodiments are defined by further 
claims. A description of said claims is here omitted for avoiding 
repetitions. 

The system and method according to the invention provide a 
plurality of important advantages. At first, it is not necessary to use a 
monochromatic or "static" background, thereby it would not be 
necessary to assemble the apparatus according to the invention in a 
closed and large sized booth provided with a background-wall or 
monochromatic curtain and, accordingly, it will allow to assemble 
the overall components of the inventive system in a column casing, 
of a comparatively small cross section, thereby the assembling 



surface of the apparatus can be drastically reduced, for example to 
0.5 m 2 , or less, whereas also the person circulating surface will 
substantially correspond to about 0.5 m 2 ; thus the overall surface 
necessary for operatively assembling the inventive apparatus will be 
of the of the order of about 1 m 2 or less. This great reduction of the 
assembling surface, corresponding to about a 1/4 of the surface of a 
prior single closed booth, will advantageously allow the system or 
apparatus according to the invention to be installed substantially in 
any commercial places or conventional stores and, moreover, either 
inside the latter or immediately outside thereof at covered regions, 
for example, in a case of a store, in an arcade way, or, in a gallery 
store and so on. 

This advantageous "non-use" of static backgrounds on the 
rear of the subject shoulders, both in an outside environment and as 
a background wall or curtain in a booth assembly, would allow to 
eliminate the prior "hole" drawback, any inaccurate boundaries of 
the subject in prior composite cards, and the large sized and 
expensive booth assemblies. 

Furthermore, a continuously present shopkeeper, or other 
store personnel, would allow to perform the money removal and 
consume material replenishing operations, at the end of a working 
day, and to immediately intervene, e.g. upon a visual and/or 
acoustical signaling by the apparatus, for example by communication 
means such as transmitting/receiving radio systems at the 
shopkeeper cash or location, to immediately recover to a good 
operating situation from a lot of possible technical problems, thereby 
greatly reducing the servicing cost and eliminating any dead 
inoperative times of the apparatus. 

Moreover, owing to the inventive method and a continuous 
presence of the shopkeeper, it would be also advantageously 
possible to provide, upon selection, in addition to the mentioned 
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composite cards, several "special products'* as thereinabove 
mentioned. 

Yet another advantage is that it would be possible, by using a 
modem and phone arrangement, to directly send to acquaintances 
and friends, for example, cards or greeting cards for a lot of events, 
via Internet, by simply introducing the required money for this 
service. Yet another important advantage is that it would be also 
possible, on one side, owing to a potential great diffusion of the 
inventive apparatus and, on the other side, the possibility of making, 
by the same apparatus, several composite cards and "special 
products", to greatly reduce the making cost while increasing the 
economic gains of an installed apparatus. 

To the above it should be moreover added that, considering 
the installation of the inventive apparatus in "unanonimous" places, 
i.e. in well zonally defined places having a well established client 
pattern, the apparatus according to the present invention can 
moreover operate as an efficient advertising means, including 
advertising messages or banners, for example related to local 
products and/or shops, such as restaurants, travel agencies, 
insurance companies, banks and the like, and this in a simple 
manner, in "temporary" video images, or in a user talking form, for 
example for a preset time period. This, likewise, will contribute to 
increasing the profitably of the apparatus according to the invention. 
A further advantageous aspect is that the users of a store installed 
apparatus would frequently contribute, as they are present at these 
places, to also increasing selling of other products offered by the 
store. 

Yet another advantage, with respect to the making cost, is that 
the novel system or apparatus including said system, would be much 
more unexpensive than conventional apparatus and booth 
assemblies, since the booth assembly and related background-wall 
or monochromatic curtain can be actually omitted. 



A further advantage is to be seen in the fact that the optical detection 
of intruder presence by software, which can be autonomously 
performed by a preferred embodiment of the suggested system, 
allows to fully eliminate both the prior detector, per se, i.e. made as 
a hardware component, and the drawbacks related to the operation 
thereof. 

In fact, a reduced number of components to be assembled and 
wired, is required, thereby providing a greater operation reliability, 
less jamming or idling of the system, as well as a less cost thereof. 

Another important advantage is that the provision of a novel 
algorithm has allowed an indirect and immediate development of the 
software in fields different from the digital printing of a composite 
image, for example in the spatial surveillance and safety field. 

Yet another advantage is that a preferred embodiment of the 
proposed software can also be used for broadening the printed 
article types to be obtained. 
Brief description of the drawings 

Further features, advantages and details of the improved 
system and method according to the present invention will become 
more apparent hereinafter from the following disclosure of preferred 
embodiments thereof, which are given by way of a merely indicative 
example, with reference to the accompanying drawings, where: 

Figure 1 illustrates a prior closed booth assembly - or a booth 
which can be closed by a curtain -, for making composite cards; 

Figure 1A illustrates a prior apparatus for introducing into a 
"view" or panorama a "subject" with an outer background on the 
rear of the shoulders of said subject; 

Figure 2 is a schematic general block diagram of the system 
according to the present invention, shown by a dash and double-dots 
frame and including a first electronic component assembly, known 
per se, shown by a dash and single-point frame, and an additional 
electronic component assembly, shown by a dashed frame; 



Figure 3 illustrates a prior exemplary composite card, i.e. 
including in a view of panorama, the face of a user at a preset 
position, in the shown example at the right, which can be produced 
according to the prior art and by the method and system according to 
the present invention; 

Figure 4 is a further schematic block diagram showing a prior 
"layered" method for making composite cards; 

Figures 4A to 4E schematically show a "view" or panorama 
and the steps for making a composite card according to the prior 
chroma-key method, in a case of using a blue color for the 
monochromatic background, in which, the steps 4B and 4B1, which 
are not actually provided, are anyhow indicated in order to facilitate 
a comparing with the steps according to the invention; 

Figure 5 is a further schematic block diagram illustrating the 
steps for making a composite card according to the teachings of the 
invention; 

Figures 5 A to 5E schematically show, by way of a merely 
indicative example, a "view" or panorama and the steps for making a 
composite card by the system and method according to the present 
invention; 

Figure 6 is a further schematic block diagram illustrating the 
steps for producing a card like that of Figure 5, to which a further 
step for additionally producing "special products" is added; 

Figure 7 is a perspective view illustrating an exemplary 
embodiment of a column casing or housing including the system 
according to the invention; 

Figure 8 is a side elevation view of the apparatus shown in 
Figure 7; 

Figure 9 conceptually shows an exchange patters for 
exchanging messages between two operating modules by the 
Registry assembly of the computer included in the system; 



Figure 10 conceptually shows the files provided for forming 
the "scratchpad time queue", in the considered embodiment six files, 
in which is copied that "reference background" to start the system 
which, in this embodiment, corresponds to the "taken" background"; 

Figure 11 is an exemplary view illustrating the backward 
sliding principle of the backgrounds for carrying out the self- 
updating step of the "reference background"; 

Figure 12 shows, by way of an example, the principle of a 
background interpolating function as applied on a "twin" image of 
the "background-subject assembly" image, for updating the 
"reference background" as said "background-subject assembly" 
image is taken, and for suppressing any transient noises from the 
"taken backgrounds"; 

Figure 13 is analogous to Figure 12 and shows a case in 
which the noise or aliasing on the image in BackO, i.e. in the 
"reference background" is represented by the subject itself; 

Figure 13 A schematically illustrates, on an enlarged scale, a 
virtual "reference background" according to the invention; 

Figure 14 is a schematic view illustrating a manner for 
preventing aliasing or noise defects from being transferred into the 
"reference background", or into the BackO image; 

Figure 15 illustrates the concept of a projection of an isoarea 
from foreground (background with subject) to background (reference 
background); 

Figure 16 illustrates the concept for eliminating "orphan" 
pixels in a multiple function processing; 

Figure 17 is a schematic view illustrating a boolean comparing 
operation; 

Figure 18 is a schematic view illustrating a KillForeOrphan () 
and a KillBackOrphan () operating functions; 

Figure 19 is a schematic view illustrating a SeekAreeOrphan 
() and a SeekAreeFore () operating functions; 



Figure 20 is a schematic view illustrating the filing or 
trimming function (); 

Figure 21 is a further schematic view illustrating a function for 
merging the "subject" into the "view" or panorama; 

Figure 22 is a further schematic view illustrating a function for 
adding written text or wordings in Overlay; 

Figures 23, 24, 25 and 26 illustrate printing layouts for some 
"special products"; 

Figure 27 illustrates a flow chart of a starting program; 

Figures 28, 28A and 28B illustrate subsequent portions of a 
flow chart of a user managing procedure or routine; 

Figures 29 and 29A illustrate a flow chart of a "special 
products" managing routine; 

Figure 30 illustrates a post-processing flow chart of "photo- 
cards and stickers"; 

Figure 31 illustrates a flow chart of a "new payment" routine 
or procedure; 

Figure 32 illustrates a flow chart of a "taking or shooting 
performing" routine; 

Figure 33 illustrates a flow chart of a "printing material 
request" routine; 

Figures 34 and 34A illustrate two consecutive portions of a 
post-processing routine for processing "visiting cards", 

Figure 35 illustrates a typical sensitivity lobe of a microwave 
sensor; 

Figure 36 illustrates the system video camera overshooting 
field, as tending to infinite; 

Figure 37 illustrates the parallax phenomenon related to the 
use of the mixed detection technique provided in the previous 
embodiment; 



Figure 38 illustrates the background updating or refreshment 
at the moment of the BackGenerator, and the building of a "virtual 
reference background" (5B1); 

Figure 39 illustrates as a detail the composition of the "virtual 
background" (5B1); 

Figure 40 illustrates the new cycle for eliminating the 

backgrounds (5B1); 

Figure 41 is a schematic general block diagram of a simplified 
surveillance and safety or security system according to the present 
invention; 

Figure 42 illustrates the inside of a store being surveilled or 
monitored by the surveillance and safety or security system 
according to the present invention; 

Figure 43 illustrates a monitoring and surveilling room of the 
store shown in figure 42, according to the prior art; 

Figure 44 illustrates a "sample image" which can be stored in 
the system as a "reference background" or as a "first image"; 

Figure 45 illustrates an image as cyclically provided by the 
video-camera, or "second image" and which is automatically 
compared with the reference image or "first image" of figure 44; 

Figure 46 illustrates a result of an analysis between the 
"second image" and "first image", which, after having performed the 
cropping, shows the presence of remaining areas indicating a 
presence of an intruder; 

Figure 47 shows a color changing of the surveillance monitor 
screen and the displaying thereon of the remaining or residual areas 
after the cropping, or of the intruder; and 

Figure 48 shows a flow chart illustrating the operation mode 
of the surveillance and safety system and method according to the 
present invention. 



Description of the preferred embodiments 

As previously stated in the introductory part, the prior 
chroma-key method substantially operates, on a side, on pixels 
having a color similar to the monochromatic basic background color 
and, on the other side, on pixels of all the other colors of the 
background-subject assembly, i.e. on pixels of a single image or 
"background-subject assembly", see Fig. AC. 

Accordingly, this is a cropping method performed on a single 
image or "mono-image" with the limitation of requiring a 
"monochromatic or static background or bottom", either inside (with 
a "booth") or outside (of a comparatively large size), and with a 
possible presence of holes or contour unevennesses of the subject, 
due to the presence, in said subject, of parts having the same color 
as the monochromatic background. 

As it will be disclosed in a more detailed manner hereinafter, 
by the system, operating architecture and method according to the 
present invention, which does require not any "monocliromatic" 
background, the cropping of the subject 6 (Figure 3) is, on the 
contrary, performed by a different method, by operating, on one 
side, on the pixels of a "dynamic" "reference background" formed in 
a virtual manner (Figure 5B1), which can be obtained by a sequence 
of "taken backgrounds" (Figure 5B), and, on the other side, on the 
pixels of the image of the "background-subject assembly" (Figure 
5C) which can optionally comprise other figures or objects taken on 
the background, which latter is potentially continuously varying, (for 
example a shop furniture assembly). The novel cropping method 
according to the present invention can be accordingly defined as a 
"two images" cropping method. 

Figure 1 shows a closed booth 1 of comparatively large size, 
said booth comprising a bottom or background monochromatic wall 
2 and a system using the "chroma-key" method for making a 
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composite card 3 which, in the exemplary embodiment shown in 
Figure 3, is constituted by a "view" 4 with a tropical seascape, as 
well as the face 6 of the user, or of the subject. 

Figure 1A shows the prior system including in a 
parallelepiped casing 7 the related apparatus as well as an outer 
monochromatic background 8, in front of which is located the 
subject 6 which, in this example, will be taken as a full "figure" 
image. 

With reference to Figure 2, the system according to the 
present invention comprises a per se known component assembly 1 1 
and a further auxiliary component assembly 12, which cooperate 
with prior or known components and with the shown software 
operating modules or programs, to carry out the inventive operating 
method, as hereinafter further disclosed, to perform the inventive 
novel process and cropping procedure. 

More specifically, the per se known component assembly 1 1 
comprises: 

- a PC 13 (and the related processor or multiprocessor, for example 
Intel Pentium II 450 MHz ® , and store 14 (for example a 128 Mb 
RAM), 

- a video acquisition board 16 having a 720 x 576 pixel resolution 
(for example Euresy "Piccolo" ® ), 

- a monitor 17 (for example a Microtouch ® touch screen), 

- a 18 PAL videocamera or a Y/C having 480 horizontal TV lines 
(for example Pulmix PEC 3010 ® ), 

- a printer 19, for example an Epson Stilus Color 900 ® ), 

- a banknote or money read-out device 21, such as an OTR "Global 
Bill Acceptor ® ), for example in the form of a coin reading device 
and/or in the form of credit cart reader and/or prepaid card reader 
and so on, 

- an optional illiirninating or lighting device 22 as well as, 

- an optional loudspeaker 23, 
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where the specifications shown in brackets indicate components 
suitable for performing the invention, likewise to the operating 
module or program assembly which will be further disclosed 
hereinafter together with their related functions, whereas the 
auxiliary or integrating component assembly 7 comprises: 

- an outer PLC 24 (for example a Mitsubishi FX2N ® with a serial 
board), and 

- a presence sensor 26 (for example an Orion ® of a microwave 
type). 

In a first variation of the above mentioned auxiliary 
components 12 is further included a directional LED 27, which 
operates, as it is energized or blinks, for prompting the user to 
automatically turn his/her face toward said LED, thereby providing a 
proper framing of the user face in the video-camera 18. 

In a further variation, said assembly 12 further comprises 
communicating means, for example a radio TX or transmitter 28 and 
a radio receiver or RX 29, said RX being, for example, arranged 
near a cash station or main place of the shopkeeper. 

The printer is indicated by the reference number 19. The 
system for printing both cards and "special product" cards, can 
comprise a single printer and associated feeding devices for feeding 
the paper media to be printed upon, as shown in Figures 23 to 26, or 
said system can also comprise a plurality of printers, one for each 
product, in a not herein shown manner. This features and details, on 
the other hand, are not further herein illustrated since they would be 
self-evident to one skilled in the art, and since they are components 
easily available on the market. 

With respect to the software operating modules or programs, 
which will be disclosed with reference to the preferred embodiment, 
they including, in part, programs applying substantially known 
methods and, in part, programs allowing to practically carry out the 



operating teachings and method according to the invention, as it will 
be disclosed in a more detailed manner hereinafter. 

For developing the novel "two image" cropping method, 
which does not use any monochromatic walls or background 
curtains, the inventor has at first considered the following two basic 
aspects: 

a) two images, to be equal, must be provided with equal color 
isoareas, arranged in a like manner, and 

b) if in one image (Figure C) of two images (Figure 5B1 and 5C) 
which should be equal, would be instead present different chromatic 
regions (for example due to the presence of the subject or face of the 
user 6), then this would mean that a detectable outer element (the 
subject 6 in Figure 5C) has introduced a perturbation or noise in the 
pixel pattern related to the subject image (background-subject 
assembly of Figure 5C) with respect to the pixel pattern of the other 
image (reference background, Figure 5B1, made as hereinafter 
shown). 

Considering the above discussed aspects, to properly perform 
the cropping method according to the present invention, a 
differential analysis between the two images is performed at first, 
see Figures 5C and Figure 5B1, based on a composition of an 
aggregating set of pixels on a chromatic and dimensional base. Thus, 
according to the teachings of the present invention, by a boolean 
comparing, a "second image", of a real type, (Figure 5C), or 
"background-subject assembly" is subtracted from a virtually formed 
working or valid "first image", (Figure 5B1) or "reference 
background", which will be virtually formed as thereinbelow 
disclosed. Accordingly, by the mentioned subtracting operation, the 
perturbation indicative regions or areas, i.e., in this case, the subject 
or face of the user 6 as taken by the video-camera 18 (Figure 5D) 
are identified. 
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According to the invention, one tries to identify and suppress 
the common areas of two images (Figure 5B1 and Figure 5C), to 
obtain as a result of said suppressing or "cropping" method, 
exclusively those areas or regions (Figure 5D) which would be 
exclusively present in the "background-subject assembly" image 
(Figure 5C) as formed by the user controlled video-camera 18. 

Thus, it would be possible to carry out the above mentioned 
procedure and method in an efficient manner by operating, for 
example, in a Visual C++ ® Microsoft ® development 
environment, since the C++ language exploits the pointer arithmetic, 
i.e. a programming method directly referring to the hardware of the 
processor and RAM, thereby directly controlling the data by 
symbolic "pointers" thereof data, without the need of carrying out 
copies to bring it again into the program, or to process and recover it 
to the system. Thus, two important advantages, and more 
specifically a high operating speed and a direct control of the 
hardware data, are thereby obtained. 

The basic software operating modules or programs are, in a 
preferred embodiment, as follows: 

Module A: The Mask.exe (written by Director by Macromedia ® 
Tins is the system-user interface. 

It displays on the screen or monitor 17, the different options 
which can be selected by the user, communicates to the system said 
user selected options, by pressing the plurality of controlling areas or 
virtual keypads shown on the screen 17. 

This program will moreover provide the necessary graphic 
animations. 

More specifically, said system will provide the following 
operations: 

• requiring the selection of the language to the user and writing into 
the Registry the related key; 

• displaying the amount of money to be introduced by the user; 



displaying several options therefrom the user can select; 

• displaying to the user the "views" or panoramas which are 
available in the selected option and writing into the Registry the 
name of the file of the image being selected by the user; 

displaying to the user the locating subject options, and writing into 
said Registry the value corresponding to the selected location; 

• displaying to the user the available "captions" and writing into said 
Registry the name of the caption file selected by the user; 

• writing into the Registry the acmating value of the Module 

Core.exe through the Module D Mailer.exe. 

• displaying to the user the video take being performed and the 

surface operating as a confirmation button or key; 
actuating the directional loudspeaker 23 supplying the user with 
information; 

• writing into said Registry the photogram capture command and 

acmating the cropping method (Module Core.exe); 

• displaying to the user the selected end product, including said 

"subject", i.e. the face of the user cropped at the end of the 
processing carried out by the Module Core.exe, Figure 5D); 

• writing into said Registry the printing value which will be sent to 

the printer 19 through the Module D Mailer.exe. 
displaying to the user the possibilities offered by the system, such 

as new views, the sending of the newly made card through 

Internet, etc. 
Module B: Core.exe (written by Visual C++ ®) 

This is the program which, through the video acquisition 
board 16, captures the images formed by the video-camera 18. This 
program operates to convert the system input video signal and 
transform said signal into an ordered pixel sequence. This pixel 
sequence would constitute the mathematical expression of all the 
geometric patterns which are present in the considered image. 
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This software Module B will operate to extrapolate the image 
of the subject 6 from the "background-subject assembly", Figure 5C, 
to locate said image on the view or panorama 4, Figure 5 A, selected 
by the user through the Module A TheMask.exe, from the plurality 
of the system prestored views. This is made by analyzing different 
chromatic equivalency areas forming the video-camera 18 taken 
image, i.e. the "background-subject assembly" or "second image" 
(Figure 5C), with respect to a virtual "reference background" or 
"first image" (Figure 5B1) generated by the BackBuild.exe. Tins can 
be performed as shown in a more detailed manner in the following 
operating disclosure of said Module B. 
Module CI: Backlni.exe (written bv Visual C++ <&) 

This Module is actuated both as the system is turned on, as 
the sequence of file images Back0-Back5, Fig. 10, is initially 
formed, and automatically cyclically for clearing and "cleaning" the 
files Back0-Back5. In this manner a sequence of files Back0-Back5 
free of residues deriving from the processing performed by the 
Module C2 BackBuild and which, by accumulating, would cause a 
declining of the cropping quality, is recovered. 

More specifically, said module will carry out the following 
operations or steps: 

• actuating the acquisition board 16; 

writing into the Registry the information for actuating the 
illuminating or lighting device 22; 

• talking a photo of the encompassing outer environment or "taken 

background" (Figure 5B) which will be written in the files from 
BackO to Back5 (Fig. 10); 

• switching the lighting device 22 off. 

Module C2: BackBuild.exe (written bv Visual C++ ®) 

It should be pointed out that, to provide a reliable cropping, it 
would be indispensable to have a good "reference background" or 
"first image" (Figure 5B1). 
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Depending on the command received by the 
Module E Golem.bin, it will perform, in a detailed manner, the 
following operations or steps: 
shifting the image previously present in the file BackO backward to 
die file Backl and so on for all the files Back to the file Back5, 
the image of which, now "old", would be suppressed, as 
schematically shown in Figures 11 and 15; 
actuating the acquisition board 16; 

writing into the Registry the information for actuating the lighting 
device 22; 

taking a photo of the encompassing outer environment or "taken 
background" (Figure 5B) which will be written in the file 
BackO (Figure 12); 
switching the lighting device 22 off. 
• Carrying out die background interpolating function (), Fig. 12, 
provided for removing image transient noises, such as reflected 
lights, which would negatively affect the subsequent cropping 
operation by the Module B Core.exe. 
In particular, between the image BackO and the 5 Backl -Back5 
backgrounds, the chromatic similitudes among the pixels at the 
same locations are reached and, if a pixel is found as 
corresponding in at least two previous images, then it will be 
confirmed, otherwise it will replaced by the twin pixel of the 
Backl image, i.e. was the latest reference background, Figure 
12. 

As schematically shown in Figure 12, line A, the pixel, such 
that schematically indicated by a coiled line Al, is held in BackO 
since it is present in at least two images or preceding events, 
whereas the pixels, represented, for example, by a small star A2 
present exclusively in BackO are replaced by the "twin" pixels 
present in Backl as is schematically shown by the small star A2', in 
thin line and by the arrow f, Fig. 12, line B, after closing the small 
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star A2' of the "hole" left by the small star A2 in BackO, Fig, 12, line 
C. 

Module D: "Mailer.exe" (written by Visual Basic ®Y 

This module operates to route all the messages to the different 
components of the system and, more specifically, from the user 
interface, Module A, "The Mask.exe", and the Module B, 
"Core.exe", during the acquisition from the video-camera 18 by the 
outer PLC 24 for managing or controlling the lighting or illuminating 
device 22 and the operations of the banknote reader 21, by 
controlling the directional LED 27 and the directional loudspeaker 

23 and, finally, by the printer, since it controls the proper carrying 
out of the printing processes provided for the individual products, 
Fig. 9. 

All the message exchange between the Module D, 
"Mailer.exe", and the Module B, "Core.exe", is carried out through 
the Registry of the computer 13, as conceptually shown in Fig. 9. 
According to the invention, in the system a new key, called 
Mainstreet, is formed, and in its inside the environmental variables 
and the commands to be carried out are stored. The message flow is 
of a bidirectional type, to update each module on the operations 
performed by the other modules. 

In actual practice, the communications between the Module 
D, "Mailer.exe", and the Module E, Golem.bin, residing in the outer 
PLC 24, are carried by using the serial port of the system and, also 
in this case, they are bidirectional communications. 
Module E: (Golem.bin (Assembler ®). 

This Module E is resident in the outer PLC 24. The 
communications between the central computer 13 and the outer PLC 

24 are performed serially by the routine RS-232C. 

The Module E Golem.bin provides, more specifically, the 
following operations or steps: 



controlling of the "timers" and the presence sensor 26 actuating 
and allowing the "taken background" taking operation; 

• actuating the Module C2 BackBuild.exe. 

To that end, after a present cycle period, for example 180 
seconds, if the presence sensor 26 does not detect any movements of 
persons or objects in the free taking field of the video-camera 18, 
then this module C2 will automatically a photo of the encompassing 
outer environment or "taken background" (Figure 5B) to be taken. 
These takeouts constitute a self-updating file operating as a base for 
providing the virtual "reference background" 5B1 according to the 
invention. The image (Figure 5B1) will be then used by the Module 
B, "Core.exe", for extrapolating from the image, Figure 5C, the 
subject areas 6 which are not present in the "reference background", 
Figure 5B1. 

• turning the lights 22 on at the taking time; 
actuating the LED 27; 

communicating to the computer 13 the banknotes read-out by the 
banknote or money reader 21. 

By a system arranged in an apparatus 31, with the video- 
camera 18 arranged in different shops or stores, optimum cropping 
operation results of the "two image" type have been obtained by 
using a BackBuild cycle with a period of 180 seconds. 

It should be pointed out that, with the exception of the 
Modules B "Core.exe" and C2 "BackBuild". exe, all the remaining 
software components or Modules A, CI, D and E do not contain 
particular technological novelties, and they can be easily made by 
one skilled in the art depending on their functions and supplied 
information, thereby they will be not disclosed in any further details. 

With reference to the figures and flow-charts, the coordinated 
functional operating procedure of the different operating modules A- 
E, or operating programs of the process for cropping composite 
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cards 3 according to the present invention will be hereinbelow 
disclosed. 

Turning the system on 

As the system or apparatus is switched on or started, the 
following operations will be performed: 
actuating the Module E Golem.bin and loading the operating 
system, 

starting the module CI Backlni.exe, driving the video-camera 18 
Q in order to perform the first taking or overshooting operation; 

IS • loading the Module D Mailer.exe; 

W • actuating the Module TheMask.exe, in the user information Idle 

?= 

Jj Loop section. 

Operating cycle of the apparatus or system, without intervention by 
Q the user 

|V In a non-use period of the apparatus, the screen 17 will 

2 display an image loop, including images for attracting the user 

P attention on the apparatus, and for supplying "a priori" a series of 

indications related to the use of the system. 

Periodically, for example typically each 180 seconds, the 

Module E Golem.bin will actuate an attention step for the presence 

sensor 26. 

If, for a cycle of 30 seconds, for example, the sensor 26 does 
not detect the presence of persons near the apparatus, then the 
Module C2 BackBuild.exe will be actuated. 

If, during this 30 sec cycle persons or other objects or animals 
pass near, susceptible to undesirably and randomly enhance by 
transient images the "taken background", Figure 5B, then the 30 sec 
timer will be cleared, and the attention cycle to the presence sensor 
26 will be reinitialized. 
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This procedure, and the consequent "reference background" 
making procedure will be cyclically repeated during the operation of 
the apparatus. 

Operation cycle of the apparatus or system, with an intervention of 
die user 

As a subject touches the screen 17 for using the apparatus, the 
presentation image loop is stopped and a screen is displayed for 
choosing the use language. By touching the selecting area on the 
screen 17, the system will store the variable related to the language 
to be used, and the proper message set will be loaded. 

The following screen display will show the money inlet 
request, by enabling the banknote or money reader 21 or the like. 
For each banknote, coin, credit or other used system, the reader 21 
will inform the outer PLC 24 about the introduced amount, which 
will be routed through the serial port to the Module D Mailer.exe to 
store it in the Registry of the computer. The Module A 
TheMask.exe will read the value present in the Registry and will 
display on the screen 17 the introduced amount and possible balance 
to be introduced again. As a previously set value is reached, the 
banknote reader 21 is disabled, and on the screen 17 is displayed a 
screen display holding herein, for example, eight themes (for 
example eight different types of views or panoramas, such as 
seascapes, mountain views, town views, soccer team views, basket 
views and so on), for the view 4 images and a selection for making 
the mentioned "special product" (winch will be disclosed 
hereinafter). 

By touching the area of the screen 17 related to one of the 
eight present themes, or stored in the system, six "view" or 
"panorama" images of the preselected theme will be displayed, 
therefrom the user can perform his/her choosing. By touching the 
desired image on the screen 17, the name of the file holding the 
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image for use as a definitive background of the card 3 or "view" 4 
will be written in the Registry. The following screen display will 
show a selection for locating the "subject" 6 with respect to the 
"view" or "panorama" 4, for example at the left, at the center or at 
the right. The selected information will be stored in the Registry of 
the computer 13. The following screen display will afford the 
possibility of adding wordings 32 (Figure 3) from a series of, for 
example, eight previously stored wordings. In an affirmative case, 
the name of the file holding the wordings 32 will be stored in the 
Registry of the computer 13. The following screen display 
containing the confirmation key therein, will actuate the Module B 
Core.exe and generate on the screen 17 a window showing the 
signal taken by the video-camera 18, or the user face. The actuating 
of the Module B Core.exe will generate a series of inner messages 
which, through the Modules Mailer.exe and Golem.bin, will turn the 
lights 22 on, while actuating the directional LED 27 as well as an 
optional playing of a voice message from the directional loudspeaker 
23. As the virtual confirmation key on the screen 17 is pressed, then 
the operations for providing a composite card 3 will be started. The 
first operating step is that of making the reference background. 

Making of the "reference background" 

Tins operation which, as above stated, is also automatically 
cyclically performed without intervention by the user, occurs as the 
user provides a command, for example touches the screen 17, for 
causing the video-camera 1 8 to take the user face, by actuating the 
Module C2 BackBuild.exe. This is the first step of the chain of 
functions to perform the cropping method according to the invention. 

The result of this operation will be a virtual "reference 
background" or "first image", (Figure 5B1), which is "updated" at 
the taking time both for the background area not covered by the 
subject 6, and for the portion thereof covered by the subject 6, 



which is "recovered" by the latest "reference background", i.e. 
Backl,Fig. 13. 

More specifically, the updating of the "reference background" 
is performed as follows: suppose that at hour 16.07 the user, in the 
illustrated case two friends, has/have commanded the taking of their 
faces, i.e. the taking of the "background-subject assembly" 13D0, 
Figure 13, line D. This "background-subject assembly" will 
obviously coincide with the "taken background", for example as 
shown in Figure 5C. At the same time, in Backl of Figure 13, line 
D, will be present the "taken background" image, 1 IS SO, which has 
been previously taken, i.e. three minutes previously, i.e. at hour 
16.04 , Figure 11, line SS, and successively shifted through the file 
Backl, Figure 13, line D. 

To provide now the "reference background" 1 1 SSO of hour 
16.04, as updated at the time of the following "taken background" or 
"reference background" of hour 16.07 (to be used for cropping the 
subject 6 from the "background subject assembly" 13D0 likewise 
taken at hour 16.07) in the "reference background" image of hour 
16.97, it will be necessary, from a side, to preserve all the areas 
outside the subject 6 and replace all the areas of the subject 6 by an 
equivalent area, showing an image present before the arriving of the 
subject, and which, according to the present invention, will be 
available in the "taken background" of hour 16.04, i.e. in the image 
1 1SS0, Figure 13, line E. This is made by applying the interpolating- 
background function () which, in this case, will consider the subject 
6 in BackO as a noise to be suppressed and replaced by "twin" pixels 
from the preceding "taken background" 11 SSO, as schematically 
shown in Figure 13, line E and in Figure 13 A. The result will be 
virtual "reference background" 5B1, since it has been artificially 
constructed by "assembling" two areas pertaining to two "reference 
backgrounds" taken at different times and, more specifically, an area 
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13D0 taken at hour 16.07 and an area EX-6, indicated by a thin line, 
and taken at hour 16.04. 

After having completed the digital making or building-up of 
the virtual "reference background" or "first image" (Figure 5B1), the 
"subject" 6 or the user face on the second image (Figure 5C) will be 
cropped by the "two image" cropping method according to the 
present invention. 

From Figure 14 it should be apparent that in BackO, line G, a 
"reference background" 14G0 successively shifted to Backl, line H, 
is present. This "reference background" has been taken at hour 16.07 
and the portion thereof corresponding to the preceding subject will 
be performed in turn three minutes before, i.e. at hour 16.04. 

The use of this image of "reference background" in Backl, 
line H, for providing a virtual "reference background" in BackO, line 

H, could generate a transfer to 14H0 of defects present in the image 
in Backl, line H. In order to prevent said defects from being 
transferred, according to the present invention it is provided to 
periodically perform, for example, each 10 revolutions of BackBuild, 
the background interpolating function with a revolution without any 
background interpolations and to restart from zero, i.e. from a new 
"taken background" as transferred to BackO and copied in Backl to 
Back5. 

Two image cropping 

The first operations are performed in preparation to the 
following functions. 

I . Shifting of the pixels of the "background-subject assembly" 

The "background-subject assembly" pixels (Figure 5C) are 
shifted by the acquisition board 16 buffer to a series of working 
arrays in the RAM store called ForeR, ForeG, ForeB, ForeN and 
ForeZ, which will then hold therein the data called Foreground. The 
arrays ForeR, ForeG and ForeB will respectively hold therein the 



values of the chromatic components red. green and blue of the 
individual pixels, the ForeN will hold therein the markings for 
attributing the pixels of the "background-subject assembly" (Figure 
5C) respectively to the "subject" or to the "background", where the 
array ForeZ will be used as a "tank" for transit temporary data 
related to the single pixels. 

The term "array" means herein the precise word for defining a 
store area (RAM) in which homogeneous data is catalogued. The 
term "buffer" is deliberately not used herein since, in the considered 
case, this could seem as ambiguous, since the video-camera buffer is 
a physically existent element, whereas said arrays are generated by 
allocating a portion of the RAM of the computer 13. 

2 . Shifting pixels of the "reference background" (Figure 5B 1 ) 

Likewise to the preceding function, the pixels of the 
"reference background" are shifted to a series of working arrays 
called BackR, BackG and BackB, which will then hold therein the 
data of the image BackO, called "Background". 

3. First differential analysis (Quantizing Fore () function) 

The first differential analysis based on the pixel isoareas 
among the arrays Fore and arrays Back is now performed. 

This is a cyclic function which is automatically repeated to 
analyze the full image pixels and it would not be possible to know "a 
priori" the iteration number to be performed. The function of this 
analysis provides to collect the Foreground data in homogeneous 
areas, or isoareas, in which the pixels would have a chromatic 
similitude. This area will be defined by analyzing the chromatic 
similitudes of adjoining pixels. 

It is found that the effect of this analysis type is analogous to 
that of an expanding "oil spot", the limits whereof are represented by 
a chromatic offset exceeding the tolerance parameters. Having 
defined a pixel set with homogeneous features, which pixel set will 
form accordingly an isoarea, all the pixels forming this isoarea are 
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assigned with a working color stored in the working array called 
"PointerFore", which corresponds to the net average of the 
chromatic values of said isoarea. Figure 15 shows that the 
configuration and location of the thus defined isoarea Fore Tl is 
"projected" on the image present in the Back T2 arrays. The average 
color obtained by the projection of the shape of the isoarea Fore on 
the Back array is stored in the working array called "PointerBack". 
As a result of this first differential analysis based on a quantization 
of the image colors, to new working arrays called PointerFore and 
PointerBack, respectively holding therein a pair of the background- 
subject assembly" image, Figure 5C, or "second image" and a copy 
of the "reference background" image, Figure 5B1, or "first image", 
constituted by the set of the isoareas identical as shape and location, 
but "smoothed" with the average of the colors of the respective 
sources, are obtained. 

4. Second differential analysis (Quantizing () function). 

A second differential analysis based on the chromatic isoareas 
among the arrays holding the image Fore and the arrays holding the 
image Back is then carried out. This function is operatively very 
similar to the preceding function, i.e. the "oil spot" search function, 
with the difference that the isoareas are now defined independently 
both for the Fore arrays and for the Back arrays. The compared 
features are the pattern or shape and location of the isoarea, in an 
independent manner for the two arrays. Upon ending the definition 
of the areas, the size evaluation is started. If the size difference of 
the two isoareas Fore and Back is found to be less than 10%, then 
these isoareas will be evaluated as similar since, being said isoareas 
present in both the images, i.e. in the "Background" image and in the 
"Foreground" image, said areas will pertain to the respective 
"background" or bottom, and not to the "subject" of the 
"background-subject assembly" image, Figure 5C. If a similitude is 
found, both the isoareas will be forcibly recolored by a pure white 
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color in both the PointerFore and PointerBack arrays. The result of 
this function will have no immediate effect on the evaluation of the 
pixel as "background" or as " subject", but it will represent a further 
improvement of the result obtained from the first differential 
analysis, thereby suppressing those areas which would have not 
been considered by the chromatic similitude analysis. 

5. Boolean Comparing (Quantibool () function) Figure 17). 

A boolean comparing of the pixels present in the PointerFore 
and PointerBack arrays is now performed. For each pixel the 
colorimetric values are read and, if the chromatic differences fall 
within a set tolerance range, then the pixel is marked in the ForeN 
array as "background" (i.e. as a suppressible pixel), otherwise said 
pixel will be marked as a "subject" pixel (i.e. as a preservable pixel). 
Then, the information for each individual pixel relating to the 
pertaining of one of the two sets "background" or "subject" of the 
"background-subject assembly", Figure 5C, will be stored in the 
ForeN array. 

Figure 17 schematically illustrates the operating mode of the 
boolean comparing between the "background-subject assembly" 
13D0 (or Fig. 5C) and the "reference background" 13F0 (or Fig. 
5B1). 

6. Third differential analysis (colorimetric analysis () function). 

A third differential analysis, based on the individual pixels 
between the Fore arrays and Back arrays is then performed. The 
image pixels present in the Fore array are individually compared 
against the twin pixels present in the Back array. This comparing is 
based on a chromatic similitude of the single pixel pair, and on an 
offset of the color delta with respect to the adjoining pixels, for 
example that arranged immediately at the left of the pixels being 
analyzed. If this difference remains within a given tolerance range, 
to be defined during the installing operation, then the two pixels will 
be evaluated as suppressible, since they will both pertain to the 



"background" of the "background-subject assembly", Figure 5C, 
and, accordingly, they will be signed or marked as a "background or 
bottom" inside the array ForeN. 

Otherwise, no changing of the ForeN array marking will be 
performed. As it should be apparent, this third differential analysis 
represents a further refining of the results obtained from the first and 
second differential analyses. 

After the last differential analysis, an image will be obtained 
which will aproximatively represent the cropped subject, however 
with a presence of a comparatively large amount of loose, isolated 
pixels, erroneous areas and cutting unnatural corners which cannot 
be interpreted by the preceding analyzing and comparing method, or 
like methods, with a consequent need of further cleaning/inte grate 
the image. 

6A. Multiple function and processing 

Then, the image will be further processed by statistic 
parameters in multiple stages. The first two functions will operate to 
suppress the "orphan" pixels, i.e. the isolated pixels, Figure 16, by 
an example with three-pixel orphan. 

7. KillForeOrphan 0 function). Figure 18 

As deriving from the definition itself, the above mentioned 
Fore array is analyzed, and the isolated pixels therein are searched, 
in this case those pixels marked as pertaining to the "subject" and 
encompassed by those pixels marked as pertaining to the 
"background", or by another pixel marked as "subject" at maximum. 
All the pixels having these features are marked as pixels pertaining 
to the "background" and accordingly supprimible. 

8. KillBackOrphan 0 function). Figure 18 

This function is equal to the preceding function, with the 
difference that it will search "background" pixels encompassed by 
"subject" pixels. As it is performed, the function will close the "hole" 
in the "subject" by modifying the marking from "background" to 
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"subject". The operating manner of the suppressing functions 
disclosed disclosed at item 7 and 8 is shown in Figure 18. 
9. SeekAreeBack 0 function). Figure 19 

At the end of the functions disclosed at items 7 and 8, those 
small defects providing a "snow" type and which are usually present 
in great amounts in the images will be removed from the image. 
However, some erroneous area, comprising a number of pixels 
greater than a single "staple" of the snow effect can still remain 
(Figure 16). This function will search in the "subject" areas sets of 

0 adjoining pixels with a "background" marking, and will verify the 
S size of these pixels. If the pixel size is less than a set threshold, 
W typically 2000 adjoining pixels, then this area will be marked or 
J signed as a "subject". 

jjj The searching procedure for establishing the area size will be 

7* the same as that of item 3, in which all the image pixels are analyzed 

G3 by the "oil spot" method, while checking the adjoining continuity of 

5 the "background" pixels and of the "subject" pixels. 

2 10. SeekAreeFore 0 function). Figure 19 

1 This function is a reverse function from that of item 9, since it 
will search "subject" areas encompassed by "background" areas. 

The operating manner of the functions of items 9 and 10 is 
shown in Figure 19. 

11. Filing or trimming 0 function). Figure 20 

At the end of the area cleaning and integrating operations, the 
image pixels will be free of any errors, related to their evaluations 
between "background" and "subject", but the edges of the cropped 
"subjects" may still have cutting and unnatural corners. 

This function, which is herein called "riling" or trimming 
function is specifically designed for smoothing the limit regions 
between "subject" and "background", by making the edge continuity 
even. 
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If excessively sharp bends are encountered along the edge, 
then this will mean that the respective considered pixel is an 
anaesthetic "spike" with respect the edge evenness. This pixel, 
accordingly, is suppressed. This is a recursive function, operating for 
a preset number of times. Good results have been obtained, for 
example, by three repetitions. 

The operating mode of this function is schematically shown in 
Figure 20. 

12. Soft 0 function 

The "subject" is now well defined, its edges are even, but an 
insertion thereof in the "view" or panorama 2 would involve 
aesthetic problems making it unnatural. In fact, the edges are 
excessively sharp and defined, and are devoid of the characteristic 
light reflections which are typical of a "subject" present in a given 
environment. In order to suppress the above mentioned drawbacks, 
good results have been obtained by using an approach which is 
broadly diffused in the graphics field. In particular the soft O 
function will search, for all the individual pixels of the "subject", 
such as the face of the user 6, the actual distance from the edge of 
said subject. If said distance varies form 0 to 8 pixels from the edge, 
then a value defining its clearness with an intensity reversely 
proportional to the distance from the edge will be applied. 

These values are not used as such, but they will be interpreted 
upon merging the two images, i.e. the "subject" 6 and "view" 4, as 
preset, and as shown at the following item 14. 

13. Definition of the special products 

If, instead of the composite card 13, the user would select 
another available option related to a special product, then the 
"special product" function chain as hereinbelow disclosed, will be 
followed. 

14. Selected "subject" and "view" merging function. Figure 21 



At the end of the analysis/comparing and end processing 
steps, the remaining pixels of the Fore image or of the "subject" will 
be embedded in the "view" image as selected by the user. 

It should be apparent that, differently from prior methods 
providing a "layering" of the image, in the inventive method, the 
involved "subject" pixels are physically replaced in the "view" 
image, Figure 21. Thus, a standard Bit map of Windows ® will be 
obtained. 

14A. "Subject" boundary special processing function. 

In order to make the "subject" edge more natural, a 
"transparency" or clearness function with a clearness intensity 
reversely proportional to the distance from the edge is applied. As 
above stated, the "subject" pixels affected by this function are those 
pixels included in a distance from 0 to 8 pixels from the edge, to 
which, for each of the chromatic components of the "subject" pixel, 
the following formula will be applied: 

Ct={C s *K + C p (l-K)} 
where Q is the value of the chromatic red, green or blue component, 
t is the value obtained by the applied clearness correction, s is the 
"subject" pixel, p is the "view" pixel, and K is a constant given by 
the formula 

K = (D r + 1 )/D t 
where D is the unit distance expressed in pixels, r is the distance of 
the pixel affected by the edge, t is the overall distance affected by 
the clearness. 

15. Overlay wording add function. Figure 22. 

As all the image of the "subject" 6, or of the user face, has 
been embedded and merged in the image of the "view" 4, then it is 
possible to add in the latter a graphics image 32, called Overlay, 
which, a above stated, holds therein wordings selected by the user 
among a given range of stored wordings or captions, see Figure 22. 
The merging process of the two images is the same shown in Figure 
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14, where, for locating the "wording regions" with respect to the not 
affected "background" regions, is used the prior "chroma-key" 
method, by using, for example, as a discriminating color, a pure 
green color. 
16. Program ending. 

The composite image is now complete and the program file, 
now including herein also other information accumulated during the 
several operations, is preserved on a disc called "end.bmp". Then, 
all the used working arrays are destroyed, and the store assigned for 
managing or controlling the program objects is recover red to the 
system. The last operation which is performed before the program 
end is that of writing the value 1 in the system Registry, at the item 
"Mainstreet/print". Tins is the signal for the Module D 
"Postino.exe", indicating that the file is ready and can be printed. 

Making of the special products 

By using the above disclosed automatic two-image cropping 
method, the data processing end handling method and related 
integrated apparatus according to the invention, Figures 2, 7 and 8, 
will allow to likewise make a lot of different "special products", for 
example in the form of "greeting cards", "photo-cards", of several 
size (Figures 23, 24), "stickers" (Figure 25), "visiting cards" (Figure 
26) and so on. Basically, the difference of the different products will 
consist of a different "view" 4 applied behind the "subject" 6 or the 
user face, and the support or medium for the printing operation. 

The different declinations of the photo processed by the 
Module B, "Core.exe", are performed by a post-processing module 
33, winch has been specifically written and controls standard data 
according to procedures which are not per se interesting. An 
interesting aspect, on the contrary, is the use of the product 
according to several declinations. In particular, this program or 
operating post-processing module 33 is embedded in the Module D, 
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"Mailer.exe", and it can be easily made by one skilled in the art in 
the light of the disclosed teachings. 

With respect to the individual "special products", the 
following is specified: 

17. Greeting cards 

The greeting cards are substantially made in the same manner 
of the composite cards 3 with the difference that, instead of a 
panoramic view as that of a picture card, as "view" 4 is embedded a 
"view" suitable for a greeting card, as pre-stored and selected by the 
user among a plurality of other preset "views" likewise to the 
programs for composite cards. It is likewise possible to embedded a 
"caption" 32, called Overlay, by using the same method as that 
shown at item 15. 

In actual practice, as the Module B, "Core.exe" ends its 
operating cycle, as shown at item 13, the screen 17 will display the 
image of the "subject" 6, i.e. the face of the user embedded in the 
preselected "view" 4, as well as the wordings 32 preset by the user 
from the prestored wordings. 

A Visual Basic ® form, holding a picture box embedding 
therein the image as suitably reseized for the printing is herein used. 

18. Photocards and stickers 

The Module B, "Core.exe", will preserve an image with the 
"subject" 6 arranged on a "view" or panorama 4 such as a white 
background or bottom, or a background of any other suitable color. 
The post-processing module 33 will provide a form including 
arranged therein the images constituting the printing format. By way 
of a merely indicative example, for the stickers (Figure 25) 16 small 
images will be provided, whereas for the photo-cards 4 or 6 larger 
images will be provided (Figures 23 and 24). Upon forming the 
composite image, it will be sent to the printer for printing it. 

19. Visiting cards. 
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A visiting card (Figure 26) is made likewise the greeting 

cards. 

More specifically, a form reflecting the selected patterns or 
layout, selected between the prestored layout range is formed. The 
layout will comprise an image, i.e. the photo processed by the 
Module B. "Core.exe", as well as a series of text cells representing 
the "vessels" provided for receiving the text will be keyed by the 
user, for example on the virtual key pad displayed on the screen 17, 
in a not herein shown manner. 

By touching one of the text fields, the digital characters of the 
key pad will fill in the field. In order to edit a further field, it will be 
sufficient to touch it, and the virtual key pad input will be addressed 
to this other field. 

By pressing the corresponding confirmation field on said 
virtual key pad on said monitor 17, the layout will be duplicated for 
a series of copies, for example three copies, on another form holding 
the actual printing size. Then, such form will be sent to the printer. 
20. Sending the product through Internet. 

It is advantageously moreover provided that, indipendently 
from the product output, i.e. a composite card or a "special product", 
it will be possible to send to a receiving party through the Internet. 

To that end, the end Bit map is reduced to a size suitable for 
displaying it on the screen and converting it into the JPG format. 

A form will permit the sending party, receiving party as an 
accompanying possible short message to be inputted, and then the 
assembly will be integrated into a HTML codified page, and 
transmitted through the network by modem and phone, by simply 
introducing the amount required for this service. 

The individual operating steps performed for carrying out the 
individual software programs or Modules A, B, C, D and E for 
practicing the teachings of the present invention have been clearly 
indicated, in a conventional manner, on the accompanying flow 
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charts, shown in Figures 27 to 34. In these flow charts, the 
respective software module or program performing the same has 
been also indicated at the most significative steps. 

Accordingly, said flow charts will be not discussed again 
herein. It should be apparent that the times indicated in said flow 
charts are merely exemplary, as discussed thereinabove. 

With respect to the above illustrated system the inventor has 
also found that, by arranging the system in crowded places, upon a 
continuous movement of persons inside and outside of the video 
camera surveillance field, the presence sensor, operating based on 
the microwave technology, sensed the continuous displacements of 
the persons, even if they were outside of the video camera shooting 
field, thereby preventing a "clean" reference background from being 
taken. 

Moreover, other types of noises, typically the light reflections 
or person shadows, were not detected since devoid of mass. 

Actually, the difference of the microwave technology used in 
the presence sensor, and which is based on the presence of a mass, 
such as the physical body of a person, and the "visual perception" of 
the system, based on the detection of the images by the video 
camera, as for the human vision, cold affect the reliability of the 
two-image cropping system in the mentioned system installation 
condition, i.e. in crowded spaces continuously traversed by persons 
passing through the video camera shooting field and/or the 
adjoining regions. 

With respect to the proposed above illustrated method and 
program or software modules for managing the system, it has been 
found that the background slipping mode in the background- 
interpolation function could be in turn improved due to following 
reasons. In fact, as it should be clear from figure 11, the 
backgrounds from BackO to Back5, useful for building the reference 
background are caused to "slip" to provide a "time history" of the 
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shooting conditions. In this connection, it should be pointed out that, 
at the shooting time, in the BackO background a "virtual reference 
background" is built-in, as shown in figure 5B1, with elements taken 
both from the "background with subject" image, figure 5C, and from 
the "reference background" image, figure 5B, i.e. without the 
subject. This, "virtual reference background", figure 5B1, 
accordingly, will be held in the reference background sequence, and 
will slip therewith. 

At the time in which, in the proposed two image cropping 
method a Backlni is carried out, see figure 10, the BackO to Back5 
reference backgrounds are "updated" by new and more actual 
images, and, accordingly, the "virtual" backgrounoVbackgrounds, 
figure 5B1, as well as the old background/backgrounds is/are 
eliminated from the image chain required for building novel virtual 
reference backgrounds. 

However, if the system is installed in a place where a 
continuous displacements of persons would hinder a regular 
BackBuild-Backlni cycle, then the sequence of the BackO ~ Back5 
reference backgrounds could hold herein only old "virtual reference 
backgrounds", i.e. without any prima facie or current information 
related to the real environment or outside word. For each operation 
performed by the user, a new "virtual reference background", figure 
5B1, would be generated with the danger that it could be 
consequently "built-in" on "old" already used virtual backgrounds 
instead of "updated" taken backgrounds, and this because of the 
above shown and hereinafter disclosed operation of the presence 
sensor. 

Operations to be performed bv the outside presence sensor 

The outside presence sensor, which constitutes per se a 
physical component, or a hardware component of the system, must 
substantially meet two requirements, and more specifically: 
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1) it must respect and functionally occupy, as far as possible, the 
video camera overshooting field, and 2) it must discriminate the 
same situations seen by the video camera. 

In the embodiment of the system disclosed above in addition 
to the detection of different objects or articles, i.e. objects or articles 
either having or not a mass, a parallax problem related to the video 
camera optical overshooting field occurred, with a consequent 
impossibility of "focalizing" the sensitivity lobe of the microwave 
sensor with respect to the taking field of the video camera. This 
parallax problem, due to a mixed use of the two technologies of the 
system and method disclosed in the previous application, is shown in 
figures 35, 36 and 37 respectively illustrating a typical sensitivity 
lobe 35 of an outside presence microwave sensor 26, in figure 35, 
the taking or overshooting field 36 of the video-camera 18 of the 
system in figure 36, as well as the parallax effects deriving from the 
use of the mixed detecting technique of figure 37, in which ZCC 
shows a correct coverage zone, ZAN an unjustified alarm zone and 
ZNR a variation not-detecting zone. 

Finally, with respect to the digitally printed products, such as 
composite cards, they were previously printed exclusively by a 
single so-called "live" mode, i.e. with the image occupying the 
overall surface of the card. 

The use, as a sensor, of the video camera of the system 
itself, allows to simplify the control of the overall system by a 
program or software module, called "BackGenerator.exe", which is 
able, through the system or video camera overshooting field, to 
accurately discriminate the most important features related to the 
two-image cropping algorithm disclosed in the previous application, 
winch algorithm has been held unchanged. 

According to an advantageous aspect of the present 
invention the suggested BackGenerator.exe program module can 
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flilly replace the two above illustrated Backlni.exe and 
BackBuild.exe modules (Modules CI and C2), since the functions 
carried out by these two programs have been embedded in the said 
BackGenerator.exe software module as illustrated in the hereinafter. 

Reference will now be made to the BackGenerator.exe program or 
software module according to the present invention, allowing to 
eliminate the prior outside presence sensor 26 and to provide a new 
optical software assisted presence detection. 

?»=.= 

m Operation of the BackGenerator.exe program module 

W The BackGenerator.exe program operates as follows: 

=S=S 

M For verifying that no disturbing persons or elements are 

2 arranged before the apparatus or system, two overshootings or 

s images are remotely taken, for example, at 1 second from one 

y another, by using the same video camera 18 of the system. 

H= The two images are chromatically compared with respect to 

i; their pixels, i.e. each individual pixel of the first overshooting or 

M= image is measured and compared with the pixel at the same position 

of the second overshooting or image. If the chromatic difference 
would be less than a preset given tolerance, then said pixel would be 
judged as the same, otherwise said pixel being marked as different. 

If, within the second image, the different pixels are less than a 
given tolerance (for example 200, with reference to a total pixel 
number of over 442,000 of the whole image), then it will be judged 
that no variations of the two images have occurred and that, 
accordingly, before the video camera no person is arranged (who 
could not remain absolutely static), and that any disturbing elements, 
such as casted shadows (i.e. persons who are directly arranged in the 
visual field of the video camera optics system but provide light 
interferences), or light reflections either of a direct or of a mirror or 
polished element reflected type are present. 
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If the condition is favorable, i.e. no disturbing element is 
arranged before the video camera, the system will switch the 
illiiminating system on and will take two other overshootings, spaced 
by 1 second from one another. These two images too are analyzed 
by the same technique to verify that, in the meanwhile, no disturbing 
element has entered the visual field of the video camera lens. 

In affirmative positive case, i.e. in the absence of disturbing 
elements, the system will switch the illuminating system off and 
store the second overshooting in the BackO to Back5 files, figure 10, 
i.e. the sequence of the reference files used for building the "virtual 
reference background" as shown in figure 5B1. 

It should be apparent that by the illustrated first embodiment 
of the system during the updating of the Back0~Back5 backgrounds, 
it was necessary to carry out a background-interpolating operation, 
to eliminate possible defects of the overshooting or taken image. 
Now, on the contrary, this is no longer necessary, and represents an 
important advantage since it is the system itself that "filters" the 
defects before taking the overshooting. 

If the two last overshootings have been found as different, 
then the system will continue to take overshootings or images, at a 
distance of 1 second from one another, while performing a 
comparing thereof so as to found a pair of overshootings or images, 
without a difference greater than the provided tolerance (for example 
200). 

If, after a number of attempts, no "reference background" is 
found, then the system will provide a signal, such as an acoustic 
signal or warning signal, and open a window on the monitor 
including a short message asking the persons near the video-camera 
to move away, while informing said persons that their moving away 
would be necessary to perform a periodic self maintenance 
operation, or allow the system to properly operate. 
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As a like overshooting or image pair is detected, then the 
lights are switches off, and the video-screen will display a greetings 
message, thereby allowing the system to complete the last 
overshooting storing operations. 

Optimization of the BackO ~ Back5 (Background Interpolation ()) 
sequence: 

As mentioned hereinabove, there are conditions under which 
the background interpolation mechanism, for building a "virtual 
reference background", figure 5B1, could be unreliable. In order to 
overcome such a situation, according to the invention, the logics for 
managing the BackO to Back5 reference backgrounds has been 
slightly modified, as it will become more apparent hereinafter. 

According to the first above illustrated method, each time a 
background interpolation operations was performed, the overall 
"time history" was caused to backward slip, by eliminating the last 
reference background (Back5.bmp), with the risk of loosing all the 
directly taken information, and only the "already used" reference 
backgrounds were processed, figure 12. 

On the contrary, according to a further preferred embodiment 
of the method of the present invention, after having performed the 
cropping, the virtual reference background, figure 5B1, is now 
caused to backward slip or slide by two positions (figure 40), 
together with all the old backgrounds, with the exception of the 
Back5 background, winch is now affected only by the 
BackGenerator.exe module, and accordingly by updated images, 
figure 40, which operation occurred, in the shown example, at 16.00 
hours. 

Later, for example at 16.15 hours, a subject overshooting 
operation for forming a card is performed. The image taken by the 
video camera is stored in the BackO background, and the 
background interpolation () function is started for summarily 
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eliminating the subject areas, and then replacing them by those areas 
arranged at the same position, coming from the Back! background. 
Thus, a reference virtual background, figure 5B1, is formed, in 
which the image portion not covered by the subject is updated at the 
overshooting time, whereas the portion "masked" by the subject 
must be recovered from a previous information (Backl~Back4). 

This virtual reference background, figure 5B1, constitutes the 
image which will be used by the cropping algorithm in order to 
discriminate the "subject" areas from the "background" areas. 

At the end of the cropping operation, figure 39, the Back4 
image is eliminated, the Back3.bmp image is displaced into the 
Back4 image, the Back2 image is displaced into the Back3 image, 
and the reference virtual background, figure 5B1, (BackO), is 
displaced into the Back2 file. 

As a last operation, the image present in Back5 is copied into 
Backl, thereby providing an updated information for the next 
interpolating-background operation, figure 40. 

Broadening of the formed product range 

Two are the innovations or improvements introduced by the 
present invention into the software module representing the interface 
to the client, i.e. into the TheMask.exe module. 

The first allows to take decisions related to the "card" and 
"greetings bill" products, as novel printed forms/patterns. According 
to the first embodiment of the proposed method the cards were 
printed by the so called "live printing" method, in which the image 
occupied the overall surface on the card. According to the invention, 
the user is now provided with the possibility of choosing the end 
product according to three patterns, for example: 1) with the prior 
live printed pattern or 2) with a frame shaped perimetrical edge or 3) 
with a frame shaped perimetrical edge and a caption at the bottom 
portion of the card, greetings bill or the like. 
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The second innovation is related to the so-called "stickers" 
and "visiting bills or cards", in which, according to the invention, it 
is now possible to select if the photo pagination must be vertical (a 
commercial form) or horizontal, thereby admitting the presence of 
two persons simultaneously, for example a husband-wife pair, a 
friend set and so on. 

Surveillance or safety application: 

As shown in great details in the above description, the two- 
image cropping technique has as the main principle of perforating a 
comparative analysis of two images in order to establish their 
differences. By the above disclosed operation set, it is possible to 
identify different areas within an image being analyzed, figure 5C, 
with respect to a reference image, figure 5B. 

In actual practice, this identifying mechanism related to the 
analyzed image variations can be used in principle, according to the 
invention, in all the fields in which it would be necessary to perform 
an image automatic analysis for different purposes. 

By way of an example, an application of the two image 
cropping technique to the surveillance and safety field, susceptible to 
be easily fitted to dangerous area control embodiments, as well as 
access monitoring and so on embodiments, will be hereinafter 
disclosed. 

The prior art status 

As an example, an area 40 such as the inside area of a goods 
store, monitored by one or more video-cameras, such as four video- 
cameras, not shown, figure 42, in which the case or box 42 number 
herein provided and the video-camera number, and related monitors 
43, figures 43, make difficult for a monitoring operator 44 to safely 
control the overall area 40, will be hereinafter disclosed. In such 
conditions, a possible intruder could not be easily detected, as 
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he/she moves through the large boxes 42 by concealing therebehind. 
If the surveillance operator does not observe the related monitor at 
the intruder movement instant, then the surveillance operator will not 
be able of detecting the presence of the intruder who could operate 
in a rather free manner. 

Improvement according to the present invention 

On the contrary, a preferred embodiment of the surveillance 
and safety system according to the present invention is simplified in 
comparison to the above illustrated system embodiment and is 
adapted to analyze the image supplied by one or more video cameras 
and detect the moving intruder bodies, independently from the image 
complexity or the presence of objects through the area being 
monitored, such as furniture pieces, vehicles and the like. 

The simplified surveillance and safety system comprises a PC 
13, a video acquisition board 16, a monitor 17 and one or more 
video camera 18, for example of the type described in the previous 
application. 

To achieve the desired end, a "sample image" is at first 
overshoot or "captured", for example at the safety system energizing 
moment, and this "sample image" is stored in the system as a 
"reference background", figure 44, for example as shown for a safe 
box 45 in a room 46. 

It should be pointed out that, differently from the provisions 
for making cards, in the considered use it is not necessary to provide 
a "virtual reference background" by interpolating the previous 
images, since the final end is not that of providing a perfectly 
cropped image, but that of "capturing" with a maximum safety each 
possible variations related to a given time or image, for example at 
the system energizing time. 

Under not-alarm conditions, i.e. in an intruder lacking 
condition, figure 44, the control monitor 43 (a single monitor being 
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advantageously provided) of the video camera/video cameras, will 
provide the normal image taken through the environment 46, figure 

44. With a cyclic frequency, for example of 3 seconds, the image 
supplied by the video camera, figure 45 is automatically compared 
with the reference image, figure 44. 

During the analyzing operation, all the shared and accordingly 
like areas are eliminated from the image, and it is controlled if are 
present remaining agglomerated pixels in more or less homogeneous 
areas, figure 46, i.e. areas which may represent a moving intruder 
person or body, not pertaining to the surveilled environment, figure 
46. In an affirmative case, i.e. if an intruder person or body is 
present, the background of the control monitor 43 will assume a 
contrasting color pattern, for example a red color, and on the 
monitor the areas different or extraneous from the reference image, 
i.e., in the considered case, the presence of an intruder will be 
stored, figure 46. 

Simultaneously, the image is stored, figure 46, together with 
the event hour and its place, for example the room access door area. 
In this case, the surveilling operator 44 can immediately display, in 
the control room, the image of the intruder 47. 

Considerations on the selection of the reference image actuating time 
(figure 44) 

Ideally, the time for taking or "capturing" the reference image 
having the best safety characteristics, is the alarm actuating or 
energizing time. 

However, cases can occur in which the taken image, figure 

45, is not a static image, such as, for example, in an outside area 
case, in which the sun rise could trigger false alarms due to the 
formations of like-shadow zones and the displacements thereof. In 
order to overcome this excessive sensitivity of the warning 



mechanism, it would be sufficient to use, according to the invention, 
a reference image programmed updating, as shown in figure 44. 

To that end an image storing cycle would be provided, to 
operate as a "reference image" for the cropped pattern, figure 44, 
with a typical time which can vary, for example, from 30 to 600 
seconds, depending on the environment variation degree, and the 
area variation analysis will be performed on a "reference 
background", figure 44, related to few minutes before the video- 
camera overshooting or taking time. Thus, the variations related to a 
time period in which the natural events, such as a light variation or 
the like, would not be sufficient to generate an alarm, but in which 
the presence of an intruder moving person or body could be detected 
and safely signaled, will be monitored. 

A detailed operation provided for such a safety application is 
shown in the flow chart of figure 48. 

From this figure it should be easily apparent that, in a case of 
a fixed reference image, it would not be necessary to program the re- 
updating type whereas, in the case of a variable reference image, the 
re-updating time, will be selected depending on the environment 
conditions of the video-camera 18. For example, in a windowed 
store, i.e. a solar light receiving store, it would be required a re- 
updating time of, for example, 3 minutes, whereas a bank caveau 
would not generally require any re-updating of the reference image 
since it would not be subjected to solar light impinging radiations 
but exclusively to a constant artificial light or dark condition. 
From the above structural and functional-operation disclosure of the 
inventive systems and methods, it should be apparent that they fully 
achieve the above mentioned objects and aims, as well as the 
mentioned advantages. 

It should be apparent that one skilled in the electronic field could 
put in actual practice the teachings of the invention also by 
modifying in different manners the software and hardware portion, 



without departing from the invention scope and spirit as defined 
the accompanying claims. 
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